課程名稱 |
高維機率論 High-dimensional probability |
開課學期 |
110-1 |
授課對象 |
理學院 數學系 |
授課教師 |
林偉傑 |
課號 |
MATH5269 |
課程識別碼 |
221 U9140 |
班次 |
|
學分 |
3.0 |
全/半年 |
半年 |
必/選修 |
選修 |
上課時間 |
星期二3,4(10:20~12:10)星期四7(14:20~15:10) |
上課地點 |
天數305天數305 |
備註 |
總人數上限:20人 |
|
|
課程簡介影片 |
|
核心能力關聯 |
本課程尚未建立核心能力關連 |
課程大綱
|
為確保您我的權利,請尊重智慧財產權及不得非法影印
|
課程概述 |
We will focus on probability theory in high dimensions with applications in data science. This course is intended for senior undergraduate students and graduate students who are interested in mathematical tools used in data science and high-dimensional statistics. Examples of high-dimensional probabilistic problems include random matrices, estimation for high-dimensional data, randomized algorithms, optimization in a disordered system etc.
This course will be divided into two parts. In the first part, we will focus on R. Vershynin's book "High-Dimensional Probability". We will talk about concentration inequalities for random variables, random vectors in high dimensions and some basic random matrix theory. If time allows, we will also cover some other interesting (and important) topics in this book.
In the second part, we will more or less follow the book "Information, Physics, and Computation" by M. Mezard and A. Montanari, and discuss how methods in information theory and statistical physics can be applied to random optimization problems. This book is a physics book, but we will try to make things rigorous. Tentative topics include the Random Energy Model, the random code ensemble, number partitioning, factor graphs and graph ensembles. |
課程目標 |
Our aim is to provide a brief introduction to some mathematical tools used in data science (in particular, the importance of these tools is rising very rapidly) that are not covered in usual undergraduate probability courses. Some applications in data science will also be discussed. |
課程要求 |
Undergraduate probability theory, analysis and linear algebra. Knowledge of measure theory is not essential but would be helpful. |
預期每週課後學習時數 |
|
Office Hours |
每週二 15:00~16:00 |
指定閱讀 |
|
參考書目 |
R. Vershynin, High-Dimensional Probability. (Available at author's website: https://www.math.uci.edu/~rvershyn/papers/HDP-book/HDP-book.html)
M. Mezard and A. Montanari, Information, Physics, and Computation. |
評量方式 (僅供參考) |
No. |
項目 |
百分比 |
說明 |
1. |
Homework |
60% |
There will be about 6-8 assignments throughout the semester. |
2. |
Take home exams |
40% |
There will be 2 take home exams. |
|
週次 |
日期 |
單元主題 |
第1週 |
9/23, 9/28 |
Introduction, random variables, basic inequalities, tail probabilities, limit theorems |
第2週 |
9/30, 10/5 |
Hoeffding's inequality, Chernoff's inequality |
第3週 |
10/7, 10/12 |
Erdos-Renyi graph, subgaussian distribution |
第4週 |
10/14, 10/19 |
Subexponential distribution, Orlicz spaces, Bernstein's inequality, examples of random vectors, concentration of the norm |
第5週 |
10/21, 10/26 |
Isotropic random vectors, more examples of random vectors, frames, subgaussian vectors in higher dimensions |
第6週 |
10/28, 11/2 |
Grothendieck's inequality, semidefinite programming, maximum cut, Grothendieck's identity |
第7週 |
11/4, 11/9 |
Second proof of Grothendieck's inequality, basic linear algebra |
第8週 |
11/11, 11/16 |
Midterm, covering numbers, packing numbers, error correcting codes |
第9週 |
11/18, 11/23 |
Random subgaussian matrices, low rank matrix detection, community detection |
第10週 |
11/25, 11/30 |
Two-sided bound on operator norm, estimating covariance matrix, Gaussian mixture model, Wigner's semicircle law |
第11週 |
12/2, 12/7 |
Proof of Wigner's semicircle law, Marchenko-Pastur distribution, Brunn-Minkowski inequality |
第12週 |
12/9, 12/14 |
Isoperimetric inequality on R^n and on S^{n-1}, concentration of Lipschitz function on the sphere, Grassmannian, Johnson-Lindenstrauss Lemma |
第13週 |
12/16, 12/21 |
Matrix Bernstein's inequality and its applications, the Sherrington-Kirkpatrick model |
第14週 |
12/23, 12/28 |
Random energy model, replica method, replica symmetry breaking, Parisi's formula |
第15週 |
12/30, 1/4 |
Bayesian inference in Gaussian noise, Nishimori's identity, Low-rank symmetric matrix estimation, BBP transition |
第16週 |
1/6 |
Discussion of the replica symmetric formula: examples, applications and approximate message passing |
|